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Abstract 

We study the optimal design of a conductance network as a means for synchronizing a given set 
of identical or nearly identical oscillators. Synchronization is said to be achieved when all oscillator 
voltages reach consensus. Synchronization performance is measured by the variance of the steady-state 
deviation from the consensus value of oscillator voltages, when all oscillators are subject to unit-variance 
noise excitations. We formulate optimization problems that address the trade-off between synchronization 
performance and the number and strength of oscillator couplings. We promote the sparsity of the coupling 
network by penalizing the number of interconnection links. For identical oscillators, we establish 
convexity of the optimization problem and demonstrate that the design problem can be formulated 
as a semidefinite program. For non-identical oscillators which can be considered as perturbations from 
a nominal oscillator, we show that it is meaningful to design an optimal conductance network by 
assuming that all oscillators are identical to the nominal oscillator. We justify this by demonstrating 
that the value of the optimal conductance matrix is insensitive (up to first order) to perturbations in the 
inductance values. Finally, for special classes of oscillator networks we derive explicit formulas for the 
optimal conductance values. 
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I. Introduction and Motivation 

Problems of synchronization are of interest in a variety of disciplines. In biology, examples 
include the synchronization of circadian pacemaker cells in the brain, pacemaker cells in the 
heart, and flashing fireflies and chirping crickets; we refer to [1] and references therein. In 
engineering and applied mathematics, extensive research has been devoted to the synchronization 
of networks of Kuramoto oscillators and networks of power generators [2]-[9]. Synchronization 
phenomena capture the attention of people with diverse backgrounds, as illustrated through the 
synchronization of mechanically coupled metronomes in the widely popular talk by Strogatz [10]. 

The literature on the synchronization of oscillator networks almost exclusively deals with 
finding conditions on oscillator couplings that guarantee their synchrony. These conditions are 
generally found for an a priori determined interconnection topology of the oscillators, and are 
often conservative. In the case of Kuramoto oscillators, a problem of particular interest is to 
characterize the onset of synchronization as a function of the coupling amplitude for a network 
of oscillators which are all coupled through identical links. Two aspects of the synchronization 
problem which seem to have not been adequately addressed in the literature are the issues 
of interconnection topology design, and, the optimality of the coupling coefficients. Indeed, a 
framework in which such problems can be formulated and solved seems to be lacking. This 
paper attempts to take a step in this direction by combining tools from optimal control theory 
and convex optimization. 

We motivate the problem addressed in this paper, and discuss its relation to the existing litera- 
ture on controller and network design, with the help of a simple example. Let two LC-oscillator 



circuits be connected by conductance 1/ R, as in Fig. la Consider two extreme scenarios: 

• = 0: In this case the two oscillators are completely decoupled from each other, and 
each oscillates at its own resonance frequency Ui = {LiCi)^^^"^. 

• = oo: In this case the two oscillators are fully coupled. The circuits can be parallel- 
combined into one oscillator, which oscillates at resonance frequency loq E [uJmm,^max] 
with cjmin = iain{u}i,U2} and cumax = max{a;i, a;2}. Thus the network achieves complete 
synchronization. 

Clearly, in the first scenario we minimize coupling at the cost of not achieving any level of 
synchronization, and in the second scenario we achieve perfect synchronization at the cost of 
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maximal coupling. As opposed to these extreme cases, in this work we try to find a middle ground 
that strikes a balance between the amplitude of the coupling and the level of synchronization. 
We also point out that it is not necessary that the oscillators be different in order for the 
synchronization problem to be meaningful. Indeed even in the case of identical oscillators, 
problems of phase and amplitude synchronization require coupling between the network nodes. 

We consider the synchronization problem for a network of n oscillators, and use the size of the 
conductance between any two nodes as a mathematical model for the amount of coupling between 
the corresponding oscillators. Our aim is to synchronize the network in a cost-effective way as 
far as the overall use of conductance is concerned. Synchronization performance is measured by 
the variance of the steady-state deviation from the consensus value of oscillator voltages, when 
all oscillators are subject to noise excitations. We employ an 7^2 optimal control framework to 
measure the amount of synchronization and also to penalize the amount of conductance used. 
Additionally, a weighted £i norm of the conductance matrix is incorporated into the objective, 
to penalize the number of interconnection links and thus promote a sparse coupling network. 

Our main contributions in this work can be summarized as follows. We employ tools from 
optimal control, compressive sensing, and convex optimization to formulate the synchronization 
problem and design optimal sparse interconnection graphs. We develop a procedure for elim- 
inating unstable modes that are also unobservable, which in the case of the synchronization 
problem corresponds to the consensus mode. We identify a class of problems for which the 
design problem is convex, and provide a semidefinite programing formulation. Furthermore, we 
use perturbation analysis to demonstrate that the solution of the semidefinite program can be 
used as a design platform for more general nonconvex scenarios. 

The problem of optimal controller design for large-scale and distributed systems has been 
considered in [ll]-[25]. Particular attention is paid to the problem of optimal structured control 
in [26]-[28], where the I-L2 norm of the closed-loop system is minimized among all controllers 
that respect a predetermined communication structure. The problem of optimal sparse control 
is considered in [29]-[31], where a combination of I-L2 norm and sparsity-promoting penalty 
terms are minimized with the purpose of identifying controllers with minimal internodal com- 
munication links. The synchronization of coupled second-order Unear harmonic oscillators with 
local interaction is considered in [9]. In this paper we adopt a framework which combines the 
optimization formulation of [29], [31] with the oscillator network model of [9]. 
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If, 




(a) (b) 



Fig. 1: Oscillator networks, (a) 2 oscillators coupled with conductance \/R. (b) n oscillators 
coupled with conductances described by matrix K. 



The rest of the paper is organized as follows. In Section|II] we describe the state-space 
model and the optimization framework in which the optimal sparse conductance matrix is 



sought. In Section III-A we demonstrate that for identical oscillators, the problem of finding the 
optimal sparse conductance matrix is convex and can be formulated as a semidefinite program. 
In SectionUV] we consider nonidentical oscillators that are small deviations from a nominal 
oscillator, and show that an optimal conductance matrix found assuming that all oscillators are 
equal to the central oscillator yields a good starting point for a more accurate design. In Section|V] 



we present an illustrative example, and in Section VI we conclude with a summary of results 



and directions for future work. To improve readability we relegate all proofs to the Appendices. 

II. Problem Formulation 

Consider a network of n LC-oscillators, interconnected by a set of conductances and subject 
to random current excitations. The conductances that connect different oscillators form the edges 
of an undirected (weighted) graph, with each oscillator connecting a node of the graph to the 



ground, as illustrated in Fig. lb For simplicity, we assume that 



d = I i = 1, . . . ,n, 

—1/2 

implying that, when considered in isolation, each oscillator resonates at frequency Ui = L- ' . 

Let V denote the column vector of node voltages. Then, taking the integral of node voltages 
J^v and the node voltages v as state variables, it is not difficult to show that the dynamics of 
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the entire network can be described by 





/ 











+ 






-H -K 




d 



where ip = [Jqv'^ f^]^ is the state vector, d is the vector of disturbance currents injected into 
the nodes, and 

H = diag{l/Lj}, K : conductance matrix of node interconnections. 

The conductance matrix K [32] can be thought of as a weighted Laplacian [32], [33], which by 
default satisfies K y and Kl = 0, with y denoting inequality in the matrix semidefinite sense 
and 1 denoting the column vector of all ones. We assume that the system's graph is connected, 
which implies the positive definiteness of the matrix K when it is restricted to the subspace 1^. 
Concisely, we write K E C with 

£,:= {K \ K = K'^, K1=0, K + y 0, K,j < for i ^ j}. (2) 

The state-space description ^ resembles that in [9], where a spectral analysis of the A-matrix 
was performed to analyze the system's convergence properties. 

It is desired to find an 'optimal' (in a sense to be made precise in what follows) matrix K 
such that 

(i) the difference in node voltages \vi — Vj\ is kept small for every i and j; 

(ii) the total amount of conductance used to connect nodes is kept small; 

(iii) the number of links between nodes is kept small. 

Objective (i) attempts to synchronize the oscillators by keeping the node voltages close to each 
other. Objective (ii) tries to maintain a small level of coupling between the nodes. Objective (iii) 
aims to obtain a sparse interconnection topology. We note that objective (iii) is sometimes relaxed 
in this paper, for example, when a particular interconnection topology is determined a priori 
and optimal values of conductances are sought within that topology. 

In order to place the problem of designing K in the framework of optimal control theory, we 
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rewrite system ([T]) in state-space form [34] as 

ip = Aijj + Bid + B2U, 
z = Clip + Du, 



with 



and 





y = 












u = 


- -Ky, 


K eC, 




A = 


/ 

-H 


, 5i = 



/ 





/ 


Ci = 


' Q'/' ' 



, C2 = / 


, D = 






The variables d and u respectively represent the exogenous and control inputs that enter the nodes 
as currents, and the variables z and y respectively represent the performance and measurement 
outputs. The positive semidefinite matrix Q and the positive definite matrix R respectively 
quantify state and control weights. In this control-theoretic framework the matrix K denotes 
the static feedback gain, which is subject to the structural constraint of being in the set C Upon 
closing the loop, the above problem can equivalently be written as 



ij = {A- B2KC2) ^ + Bid, 



(3) 



-R^/^KCo 



where it is easy to see that the closed-loop A-matrix, A^x = A — B2KC2, is given by the A-matrix 
in Q. 

We further assume that 

^ 

Q2 



Q 



(4) 



where Q2 satisfies Q2t = and is a positive definite matrix when restricted to the subspace 1-*-, 
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I.e., 



and 



Q2I = 0, C^Q2 C > for all C 7^ such that C^l = 0, 



R = rL r > 0. 



To justify the structural assumptions on Q, we note that in order to achieve synchronization we 
are interested in making weighted sums of terms of the form (t>j — VjY small. Owing to the 
choice of state variables [ J 



yT-jT^ gu^j^ objective corresponds to Q matrices with the zero 
structure displayed in (|4]) and Q2 matrices that are positive semidefinite and satisfy = 0. 
For example, in a system of two oscillators, if it is desired to make (f 1 — ^2)^ small then Q has 
the structure shown in with 



Q2 



1 



1 -1 



1 -1 
-1 1 



We now state the main optimization problem addressed in this paper, then elaborate on the 
details of its formulation in the next paragraph. Consider the problem 



minimize := tTace(PBiBf) + 'j \\WoK\\i-^ 
subject to {A - B2KC2YP + P{A - B2KC2) 



iQ + C^K^RKC2 



(5) 



where K is the optimization variable, H-ft'llfi = j l^ul '^he £i-norm of K,W h a. weighting 
matrix, o denotes elementwise matrix multiplication, and C is the set of weighted Laplacian 
matrices corresponding to connected graphs as defined in ([2]). 

We next elaborate on the formulation of the optimization problem (|5]). When 7 = 0, the 
objective function 

J := tiace{PBiB^) 

is equal to the 7/2 norm, from input d to output z, of the closed-loop system ([3]). This can be 
interpreted as the amount of steady-state variance amplification from d to z, when the input d 
is a stochastic disturbance. Solving ([5]) for 7 = is closely related to the design of structured 
feedback gains [26]. The condition K E C ensures that is a legitimate conductance matrix. It 
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is important to note that due to our particular choice of the performance output z, by minimizing 
J we are effectively achieving the first two of our optimal synchronization objectives outlined 
earlier. Furthermore, it has been demonstrated recently that t\ optimization can often be used as 
a relaxation for cardinality minimization [35], [36], where the cardinality card(-ft') of a matrix 
K is defined as the number of its nonzero entries. Indeed, the term 7 oi^||^^ in the objective 
function of ([S]) attempts to approximate 7 card(-R') in penalizing the number of nonzero elements 
of which in terms of the synchronization problem can be interpreted as penalizing the number 
of interconnection links. The weighting matrix W can be updated via an iterative algorithm in 
order to make the weighted t\ norm \yV o K\i^ a better approximation of card(_ft') [31], [36]. 
We next describe one such algorithm. 

A. Sparsity-Promoting Reweighted ii Algorithm 

Reference [36] introduces the reweighted t\ minimization algorithm as a relaxation for cardi- 
nality minimization. This methodology was recently used in [31] to find sparse optimal controllers 
for a class of distributed systems. We now state the reweighted t\ algorithm for the sparse optimal 
synchronization problem. 

Algorithm 1 Reweighted £1 algorithm 

1: given (5 > and e > 0. 
2: for /i = 1, 2, . . . do 

3: If /i = 1, set K^'''^ := 0, set Wij := 1, form W. 
4: If /i > 1, set i^P'^^^ equal to optimal K from previous 
step, set 

1 

^ij ■— I Tv-prev I , r ' 
l-^^ij I "T " 

form W. 
5: Solve ^ to obtain K*. 
6: If -i^P'^'^^ll < e, quit. 
7: end for 



Henceforth in this paper, unless stated otherwise, we will only address solving the optimization 
problem ([5]) for a given weighting matrix W, which corresponds to Step 2 of the above algorithm. 
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B. Simplification of Problem ([5]) 

We begin by exploiting the structure of the Lyapunov equation that appears in the optimization 
problem ([5]), 

{A - B2KC2fP + P{A - B2KC2) = -iQ + C^K^RKC2). 
Substituting the expressions for A, B2, C2, Q, and 



Pi Po 
' 



P^ P2 



^ 0, 



yields 



1 ^ 
























Pi 


Po 




Pi 


Po 




I 












+ 














^0 


P2 




p^ 


P2 




-H -K 







Q2 + rK^ 



/ 

-H -K 

Rewriting this equation in terms of its components gives 



(6) 



HP^ + P^H 
PoK - Pi + HP2 








(7) 



KP2 + P2K - Po - Po = Q2 + rK 



The condition P y implies that Pi ^ and P2 y 0. Finally, we use the block decomposition 
of P to simplify the objective function in (|5]), 

trace(PPiPf) = trace(P2). (8) 

III. Case of Uniform Inductances: A Convex Problem 

In this section we make the following simplifying assumption, which we refer to as 'uniform 
inductance'. 

Assumption 1: Let all inductors have the same value, i.e.. 



Li = Lo, i = 1, . . . ,n, 



(9) 
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for some Lq > 0. This implies 

H = (1/Lo)/ >- 0. 

Remark 1: This assumption is restrictive in that all oscillator circuits now have the same 

— 1/2 

resonance frequency Uq = Lq ' (recall that all capacitor values are equal to one). However, 
the synchronization problem is still meaningful, as it forces the oscillators to reach consensus 



on their amplitudes and phases and oscillate in unison. In Section IV we show that the uniform 
inductance scenario provides a valuable design platform for the more general case in which 
different inductor values constitute small deviations from the nominal value Lq. 

From the uniform inductance assumption ^ it follows that H = (I/Lq)/ commutes with any 
matrix and therefore the first equation in (|7]) becomes 

Po + Po = 0. 
Hence the last equation in (|7]) simplifies to 

KP2 + P2K = Q2 + rK^, (10) 

with P2 >z 0. Furthermore, from ^ it follows that the objective in ^ is equal to trace(P2) and 
is independent of Pq and Pi. The optimization problem (|5]) can thus be rewritten as 

minimize trace(P2) + 7||W^°-^||£i 

subject to KP2 + P2K = Q2 + rK^ (11) 
K eC, P2 ^ 0. 

To simplify the optimization problem further, we state the following useful lemma. 

Lemma 1: Let A and Q be given symmetric matrices that satisfy At = Ql = 0, and suppose 
that A is negative definite when restricted to the subspace 1-*-. For the Lyapunov equation 

A^V + VA= -Q, (12) 

the following statements hold. 



(i) If P is a solution of the Lyapunov equation (12) then so is V + all for any a G 



(ii) If P is a solution of the Lyapunov equation (12) and Q is positive semidefinite on 1 , 



then 1 is an eigenvector of V and V is positive semidefinite on 1-*-. Furthermore, among 
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all P ^ that satisfy ([T2]) the one with the minimum trace satisfies VI = 0. 



(iii) Any solution V of the Lyapunov equation (12) satisfies 



trace(P) = p - (1/2) trace(Q^"^), 
V = (p/n) 11'^ + V^, 

for some p G M and matrix P-*-, where p is independent of A and Q, V^l = 0, and 
denotes the Moore-Penrose pseudoinverse of A. Additionally, if Q is positive semidefinite 
on 1-*- then so is V-^. 

(iv) The identity trace(Q^I^) = trace(Q(^ — holds and any solution V of the 

Lyapunov equation ([T2]) satisfies 



trace(P) = p- (1/2) trace(Q(^ - ll'^/n)-^), 
where p G M is independent of A and Q. 

Proof: See Appendix. ■ 
Remark 2: An important consequence of Lemma[T]is that the new description of trace(P), 

trace(P) = p - (1/2) trace(Q(^ - 11^/n)-^) 

= p- (1/2) trace(Qi/2(^ _ tt^ /ny^Qi/^)^ 

lends itself to the application of semidefinite programing (SDP) methods, as we demonstrate 
below. This is reminiscent of the results in [32]. 

Remark 3: We will demonstrate that, in the case of uniform inductances, p is a free parameter 
whose value does not affect the optimal inductance matrix we seek. It turns out that when the 
uniform inductance assumption is removed then p takes on a determinate value. However, the 
optimization problem and the optimal inductance will continue to be independent of p, as we 
show in SectionlTVl 

Applying Lemma[T] with A = —K and Q = Q2 + rK^ to the Lyapunov equation (10) with 
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-^2 ^ gives 

trace(P2) = P+ (1/2) trace((g2 + rK^)K^) 

= p+ (1/2) trace(Q2(i^ + ll^/n)"^ + rK{I - ll^/n)) 

= p+ (1/2) tTace{Ql^\K + ll^/n)-^Ql^^ + rK), (13) 



where p G M is independent of K and Q2. The details of the simplifications in (13) are as 
follows: Since K is the Laplacian of a connected graph then Kl = and K is positive definite 
on 1-*-. Also, by assumption = and Q2 is positive definite on 1-*-. Thus {Q2 + rK'^)l = 
and Q2 + rK^ is positive definite on 1^. Therefore Lemma[T] applies and the first equation 
follows. In the second equation, Ql = and the identities K^^ = (K + 11^/n)^^ — ll^/ra, 
K'^K = I — 11"^ /n are invoked. Finally, the last equation follows from Kl = and the trace 
identity trace(MiM2) = trace(M2Mi). 

In summary, problem (|5]), which had been simplified to ( [TT] ) using the uniform inductance 
assumption Q, is further simplified with the help of Lemma[T] and ( [T3] ) to obtain the equivalent 
problem 

minimize (1/2) tmce{Ql^^{K + 11^ /n)~^Ql^^ + rfsT) + 7 \\WoK\\e^ 

(14) 

subject to K e C, 

where the parameter p has been dropped from the objective, as it has no effect on the solution 
of the optimization problem. 

A. SDP Formulation 



The following proposition provides an SDP formulation of (14) 



Proposition 2: The optimization problem ([5]), under the uniform inductance assumption (|9]), 
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is equivalent to the semidefinite program 

minimize (1/2) trace(X + rK) + 7 trace(ll'^y ) 
X 



subject to 



^ 



(15) 



Ql^^ K + tt^/n 
MoK<0, Kl = 

-Y < WoK < Y, 

where the optimization variables are the symmetric matrices K and X and the elementwise- 
nonnegative matrix Y, < denotes elementwise inequality of matrices, and 



M 



11^ - / ~ 



1 1 

1 1 
1 1 



Proof: See Appendix. ■ 
We note that the optimal conductance matrix is independent of the inductance matrix H when 
all inductances have the same value. In other words, the optimal K does not depend on the 
oscillator parameters when all oscillators are identical. 



B. Special Case: Uniform All-To-All Coupling 

A problem of particular interest in oscillator synchronization is that of uniform all-to-all 
coupling [1]. This scenario, although nonsparse, can be easily addressed using the framework 
developed in this paper. In this case every oscillator is connected to all other oscillators and all 
couplings have the same magnitude (i.e., all conductances have the same value). This implies a 
particular structure on K, 

K = k{I-ll^/n), 

where A; is a positive scalar. 

In the uniform all-to-all coupling problem the structure of K is already determined, thus the 



sparsity-promoting term 7 ||iyoir||^^ can be removed from the objective of (14). Equivalently, 
we can consider ([141) ^^^^ 7 = 0. Clearly, the reweighted £1 algorithm is unnecessary in this 



case (as W is not used and does not need to be updated), and the problem simplifies to finding 
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the value of k that minimizes J = trace(P2)- 
It is easy to show that 

= (l/k) [I-U^/n) 



Thus from ( [13] ) it follows that 

2J = trace((g2 + rK^)K^) 



{l/k) trace(Q2(/ - tt^ /n)) + rfctrace((/ - 11^ /nf) 
{l/k) trace((52) + rk{n- 1). 



Setting dJ/dk = we obtain 

^ _ / trace(Q2) y/^ 
\ {n — l)r ) ' 

and therefore the optimal conductance matrix is given by 



K=C^^P^)"\l-\\^/n). 
{n — l)r 



(16) 



Notice that the optimal conductance matrix depends only on the trace of Qi and not on its exact 
structure or its individual entries. 

IV. Gradient of J and Case of Nonuniform Inductances 

In this section we consider the case of nonuniform inductances. We demonstrate that an 
optimal design performed for networks with uniform inductances serves as a good starting point 
for an optimal design for networks that do not satisfy this assumption, as long as the inductance 
values are close to each other. 

Let inductor values Lj constitute small deviations from some nominal value Lq, 

Li = Lo + SLi, i = l,...,n, (17) 

with 

\5Li\ < Lq, 

In this case, once the interconnection topology and link weights have been determined by solving 
the optimization problem ([5]) under the assumption (|9]), a perturbation analysis can be employed 
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to update the conductance matrix to accommodate for the nonuniform inductance values in (17). 
We refer the reader to [27], [28] for additional information regarding use of perturbation methods 
in the design of optimal distributed controllers. 

Proposition 3: Consider the problem of minimizing J = trace (Pi?i-Bf) subject to the equa- 
tions ^ and the constraints K E C, P y 0. Small changes 5H and SK in the inductance 
and conductance matrices, respectively, around the point H = (I/Lq)/ and K, result in small 
changes 5 J = tia,ce{6PBiBf) in the value of the objective function. Then 

5J = 6p + {l/2)tT&ce{{rI - K^Q2K^)6K), 

where 5p is a function of 5H but is independent of 5K. In particular, 

VkJ = (1/2) (rl-K^Q^K^), 

where the gradient is evaluated at the point {(1/ Lq)I , K). 



Proof: See Appendix. ■ 
We point out that the conditions P2I = and 5P2I = are used to remove the ambiguity from 
the Lyapunov equations that define P2 and 5P2, by invoking Lemma 1 to select a minimum- trace 
solution. 

Remark 4: The utility of Propositions can be explained as follows. 

• If the inductances of different oscillators can be considered as small perturbations from 
some nominal value Lq and thus 

H{e) = + eH^^\ 

with 

H^'^ = (1/Lo)/, 

then the expression for 5 J given in Proposition 3 implies that at least up to first order in 
e, the value of the optimal K remains unaffected by variations H^^^ in H. This shows a 
degree of insensitivity of the optimal K to the deviation of inductances from their nominal 
value Lq. This effectively implies that an optimal design performed for the case of uniform 
inductances serves as a good estimate for the globally optimal solution in the case of 



Febniary 5, 2013 



Submitted to IEEE Trans. Automat. Control 



16 



nonunifrom inductances, if the inductances comprise perturbations from a nominal value. 
The gradient VrJ = (1/2) (t'I — K'^Q2K'^) can be used to compute a descent direction in 
numerical optimization methods. Furthermore, setting V^-J = gives 

K^Q^K^ = rl 

as a necessary condition for optimality. Multiplying both sides by K and using KK'^ = 
K^K = I - Ql = 0, results in = Q^jr. Thus the optimal K is given by 



K = Q^/r 



1/2/ 1/2 



(18) 



V. Illustrative Examples 

A. Example 1 

In this section we consider n = 7 identical oscillators and design a sparse conductance matrix 
using the sparsity-promoting algorithm of Section |ll[ with the optimization problem in Step 2 of 



the algorithm being (15). 
Let r = 1 and 



Q2 = 



1 

-1 








-1 
2 -1 

-1 2 
-1 



-1 





2 -1 
-1 2 
-1 



The optimal conductance matrices K^, for different values of 7, are given below. For all 
computations we used CVX, a package for specifying and solving convex programs [37], [38]. 



we recover Kq 














0.84 


-0.52 


-0.13 


-0.07 


-0.05 


-0.04 


-0.03 




-0.52 


L23 


-0.46 


-0.11 


-0.06 


-0.04 


-0.04 




-0.13 


-0.46 


1.25 


-0.45 


-0.11 


-0.06 


-0.05 


Ko = 


-0.07 


-0.11 


-0.45 


1.25 


-0.45 


-0.11 


-0.07 




-0.05 


-0.06 


-0.11 


-0.45 


1.25 


-0.46 


-0.13 




-0.04 


-0.04 


-0.06 


-0.11 


-0.46 


1.23 


-0.52 




-0.03 


-0.04 


-0.05 


-0.07 


-0.13 


-0.52 


0.84 
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Ko.i = 



0.80 


-0.55 


-0.14 











-0.11 


0.55 


1.19 


-0.47 


-0.17 











0.14 


-0.47 


1.22 


-0.45 


-0.16 











-0.17 


-0.45 


1.24 


-0.45 


-0.17 











-0.16 


-0.45 


1.22 


-0.47 


-0.14 











-0.17 


-0.47 


1.19 


-0.55 


0.11 











-0.14 


-0.55 


0.80 


0.57 


-0.57 

















0.57 


1.14 


-0.57 














n 
u 


n ^7 
— u.o / 


1 1/1 




n 
u 


u 


n 
u 








-0.57 


1.14 


-0.57 

















-0.57 


1.14 


-0.57 

















-0.57 


1.14 


-0.57 

















-0.57 


0.57 



B. Example 2 



We consider the all-to-all coupling example of Section III-B We show the insensitivity of J 
to deviations of inductances from a uniform nominal value. 
Let 

Q2 = q{I - 11^/n), K = k{I- 
where q and k are positive scalars. We demonstrate that 

Po = 0, Pi = HP2, P2 = (f)I + 



with appropriate values of 0, « G M, serves as the solution to the set of equations (|7]). Substitution 
into the last equation of (|7]) gives 

2(f)k{I -U^/n) = {q + rk^){I -11^/ n), 

or 

q + rk^ 



2k 

Thus P2 = ((g + rk"^) / {2k))I + a 11^ satisfies the last equation in ^ for any a G M. In 
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the case of uniform inductors, when iJ is a multiple of the identity H = {1/Lq)I, the second 
equation in Q renders Pi = {{q + rk"^)/ {2 Lq k))I + (a/Lo)ll^. Thus the freedom in choosing 
a extends to the matrix Pi. This is not surprising, since in the case of uniform inductors the 
closed-loop A-matrix in ([T]) has a pair of eigenvalues on the imaginary axis, which results in 
nonunique solutions to the Lyapunov equation (|6]). However, in the case of nonuniform inductors 
the equation Pi = HP2, together with the symmetry condition on Pi, forces a to be zero. Hence 

" ' 2k ' 2k ' 

is the solution of Q, and 

J = trace(PPiPf) = trace(P2) = — — n. 

Setting dJ/dk = we obtain 

k = {q/Tf/\ 

and therefore the optimal conductance matrix is given by 

K = {q/rf/^{I -11^ /n). 
Indeed, the above expression for the optimal K is in complete agreement with those given in 



^ and ([is]), since trace(g2) = gtrace(/ - = q{n - 1) and Q^^ = q^/'^{I - 11^/n). 

Clearly, for this simple example J is independent of H, and therefore so is the optimal K. 
In particular, the optimal K is insensitive to changes in the inductance values. 

VI. Conclusions and Future Work 

We have proposed an optimization framework for the design of (sparse) interconnection 
graphs in LC-oscillator synchronization problems. We have identified scenarios under which 
the optimization problem is convex and can be solved efficiently. 

Our ultimate goal is to establish a constructive framework for the synchronization of oscillator 
networks, in which not just the issue of synchronization but the broader questions of optimality 
and design of interconnection topology can be addressed. For example, it can be shown that 
a linearization around the consensus state of the nonlinear 'swing equations,' that arise in the 
description of power systems, can be placed in the design framework developed in this paper and 
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ultimately expressed as a semidefinite program. As another example, it can be shown that after 
applying a sequence of transformations to ([3]), the resulting equations closely resemble those of 
the Kuramoto oscillator. We aim to exploit these similarities for the purpose of optimal network 
design in our future work. 

Appendix 

Proof of Lemma^ 

The proof is based on using a special similarity transformation to eliminate the common zero 
mode of A and Q from the Lyapunov equation A^V + VA = —Q. 

To prove (i), let V satisfy the Lyapunov equation in the statement of the lemma. Recalling 
that A is symmetric and At = 0, we have A^iV + at 1^) = A^V and {V + at 1^)A = VA, 
where a is a free parameter. Thus 

A^iV + alt^) + {V + al t^)A = -Q, 

and V + all'^ too satisfies the Lyapunov equation. This proves statement (i). 

To prove (ii), note that since A is symmetric it can be diagonalized using a unitary transfor- 
mation V, 

A = VAV^, 

where Vi, i = 1, . . . ,n denote the orthonormal eigenvectors of A and constitute the columns 
of V; Aj, i = 1, . . . , n denote the eigenvalues of A and constitute the diagonal elements of A, 
A = diag{Aj, i = 1, . . . , n}. Recalling that ^1 = 0, we assume without loss of generality that 



Ai = 0, Vi = 1/y/n. 



Then V 



-^1 V 



with V^l = 0, and 



V^AV 



A 



-^1 V 




A 
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where A = diag{Aj, i = 2, . . . , n}. Since A is negative definite on l-*- then A -< 0. Similarly 

V^QV = 




Q 



which results from Qt — and the symmetry of Q. If we further assume that Q is positive 
semidefiniten on l"*- then Q>z 0. 

Considering the Lyapunov equation A^V + VA — —Q and multiplying both sides from the 
left by and from the right by V, we obtain 

V'^AVV + V'^VAV = V^AVV^VV + V^VVV^AV 

= -V^QV. 



Using 



V^VV 



Pi Po 
Po V 



we amve at 











Pi 


T 

Pa 


+ 


p\ 


T 

Po 





















A 




Po 


V 




Po 


V 







A 







Q 



where pi is a scalar, pq is a column vector, and V is a matrix. Rewriting the above equation 
component-wise gives 



Apo = 0, AV + VA 



and pi is a (.4.- and Q-independent) free parameter. From A it follows that 
therefore 

' Pi 

v 



Po = 0, and 



vv 



In particular, this implies Vt — Pit and thus 1 is an eigenvector of V with pi as its corresponding 
eigenvalue. Furthermore, it is easy to show that V :— e^* Q e^* dt is the unique solution to 
the Lyapunov equation AV + VA = —Q when A -< 0. If we assume that Q h then V h 0, 
and V is positive semidefinite when restricted to the subspace 1^. 
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Finally, we have 



trace(P) — pi + trace(P). 



If V y then pi > 0, in addition to "P ^ 0. Hence the minimum trace of V is achieved for 
Pi — 0, which renders Vt — 0. This proves statement (ii). 
To prove (iii), we note that 



Pi 

v 

= (pi/n) 11^ + VVV^, 

with VVV^t — 0. If we additionally assume that Q is positive semidefinite on 1-*-, then Q>zO, 
V hO, and :— VW^ is positive semidefinite on 1-*-. 

Also, from AV + VA^ -Q and [39, Lemma 1] we have trace(P) = -(1/2) trace(QA-^), 
which implies 

trace (P) = pi + trace(7^) 

= pi - (l/2)trace(QA-^). 

To further simplify the above expression and express trace(P) in terms of the Moore-Penrose 
pseudoinverse A\ note that from A = VAV^ and the SVD procedure for finding the pseudoin- 
verse, we have 




A-i 



Thus 




A-1 
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and 











Q 








trace (QA ^) = trace ( 



= trace(V^QVV^^"^V) 
= trace(Q^"^). 

This proves statement (iii). 

To prove (iv), the identities A'' A = I — ll^/n and A^^t = can be employed to show that 
[32] 

= (A-tl'^/n)-^ + 

which gives 

trace(Q^^) = trace(Q(^ - ll'^/n)"^ + Qll^/n) 
= trace(Q(^- 

This proves statement (iv). The proof of the lemma is now complete. 



Proof of Proposition 2 

If Q2 was positive definite and thus invertible, then replacing (1/2) trace(Q2^^(-^+ll"^/^)~^Q2^^) 



with (1/2) trace(X) in the objective function of ( 14 1, subject to the linear matrix inequality (LMI) 
constraint 

Q2^' K + ll^/n 



would follow from a simple application of the Schur complement [40]. In particular, this would 
establish the positive definiteness, and thus the invertibility, of + 11^/n, and the optimal X 

1 /2 

that minimizes the objective subject to the LMI constraint would be given by X = Q2 {K + 
ll^/n)-iQ2^l However, since (52I = and therefore Q^"^ is singular, we can only conclude 
from the above LMI that K + 11^/n is positive semidefinite. We next demonstrate that K + 
11^ /n is indeed invertible. 

Using the unitary transformation V from the proof of Lemma 1, the above LMI holds if and 
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only if 


















X 











T 

Xq 










V 







Xq 


X 





Q 







V 










1 














Q 





k 



^0, 



where the upper-left 2-by-2 block is the appropriately partitioned matrix V^XV, the upper- 
right 2-by-2 block is the partitioned matrix V^Qy^V in which the zero structure follows from 

Qy^l = 0, and the lower-right 2-by-2 block is the partitioned matrix V^{K + ll^/n)V in 
which the zero structure follows from Kl = 0. Using a permutation of the rows and columns, 
the above LMI is equivalent to 



^0, 



Xi 





T 

Xq 








1 








T 

Xq 





X 


Q 








Q 


K 



which in particular implies that 



X Q 

Q k 



>- 0. 



Since Q^^ is positive definite on 1^ then Q = V'^Q^^V y 0. Thus K = V^{K+ll^/n)V y 0, 
and therefore V'^{K+lt'^ /n)V y 0. This implies (K+ll^/n) y 0, and K+ll^/n is invertible. 

The term ||W^ofr||£^ in the objective function can be replaced with trace(ll^y), subject to 
the LMI constraint [41] 

-Y < WoK < Y. 



Finally, constraint K e C, which guarantees that K is the weighted Laplacian of a connected 
graph, is equivalent to the set of conditions 

K^K^, MoK<0, Kl^O, K + ll^/nyO. 

The first and last of these conditions are automatically fulfilled when K satisfies the LMI, and are 
therefore dropped from the formulation of the optimization problem. The proof of the proposition 
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is now complete. 



Proof of Proposition 3 

It is desired to compute variations in J that result from variations in K and H, with the 
variations in H occurring around the point H = (1/Lq)I. 

Let A^*^°)), if^") := (I/Lq)/, denote the point at which the variations in J is to be 

computed. Note that K'^'^'> can be any conductance matrix and is not necessarily equal to the 
optimal conductance matrix found from solving (15). Recall the Lyapunov equation in (|5]), or 
equivalently the equations (|7]) 

HP^ + PoH = 
PoK - Pi + HP2 = 
KP2 + P2K - Po - Pq = Q2 + rK^. 

Then small changes in H and K, 

Hie) = + eH^'\ 
K{e) = 

result in small changes in the matrices Pq, Pi, P2, 

P^(e) = P^'^ + ePi^^ + 0(^2), ^ = 0, 1, 2. 

We note that /f^^^ is a diagonal matrix, and that K^^^ is such that K{e) is a legitimate conductance 
matrix; this, in particular, means that K^^^l = 0, f^*^^^^ = K'^^\ 

Substituting into (|7]) the expansion around their nominal value of each of these matrices, and 
rearranging terms according to powers of e, renders (up to first order in e) the set of equations 



( 19)-(20), where, in particular, P/™^^ = P/™^ for / = 1, 2 and m = 0, 1. 
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0(1) : \ Po(°)ir(o) - P(°) + if(o)pf 

[ ir(o)pi°) + Pi°)ir(o) - P(°) - P(°)^ 

0(6) : <^ Pq^^^kW - p(i) + ff(0)p2(i) 

I ir(o)pi^) + Pi^^irW - P(^) - P(^)^ 



= 

= (19) 

= Q2 + rK^-'^^K^^^ 

= -i/(i)p(°)^ - p(°)i/(^) 

= -iJ(i)pf - Po^^^ird) 

= rir(i)ir(0) + rirWir(i) - ir(i)pf - Pf 

(20) 



It can be shown that the set of equations 



,(0) 



(0) 



^1^ 

KWpi^) + Pf 





^(O)p(O) 

Q2 + rK^'^K^''^ 



(21) 



are equivalent to the 0(1) system of equations in (19). To see this, we first use that H^^^ 



is a multiple of the identity and commutes with every matrix. The first equation in (19) thus 
becomes Pq^^+Pq"'*^ = 0, which implies that P^f^ is an antisymmetric matrix. Taking the second 
equation in ( [T9] ), transposing both sides and then subtracting from the original equation gives 

= 0. Invoking the antisymmetric property of Pq°^^, we obtain J^^^^Pg^"^ + 

p(0)^(0) 

= 0. Using a similar argument to that presented in the proof of Lemma[l|ii), any 
solution of this equation should be of the form Pq°^ = ipll'^ for some > 0. But since Pq°'' 
is antisymmetric if can only have the value zero and thus Pq°^ = 0. The rest of the equations 



in (|21[) now follow trivially. Furthermore, using (|21[) and Pq°^ = it also follows that the set of 



equations 



p(l)T 



p(l) 
-'1 

^(0) p(l) ^ p(l)^(0) 



P(^)ir(°) + if(o)pi^) + if(i)pf 



(22) 



are equivalent to the 0{e) system of equations in (20). 



In order to use LemmajT to derive an expression for trace(P2^^), we have to demonstrate 
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that the vector 1 is in the null space of the matrix on the right side of the last equation in 



(22). We know from K^^H = K^'^H = that [K^^^K^^^ + K^^^K^^^)1 = 0. We next show that 



(^;;^(i)p^(o) _^ P2^°)i^(i))i = 0. The last equation in together with Lemma[ljiii), implies that 
^ = rll^ + T for some r G M and matrix T, Tl = 0. Thus 

^K^pW + Pf = i^W(rll^ + T)l + Pf i^Wl 

= 0, 

which is the desired result. We are now in position to apply Lemma[T] 
The last equation in (22), together with Lemma[TJiii), implies 



trace (P2^^^) 

= + (1/2) trace((ri^(°)ir(i) + rK^'^K^-''^ - K^'^P^'^ - Pf ir(i))KWt) 
= + (l/2)trace(2rir(i) - ir(i)pf iT^t _ p(o)^(i)^(o)t) 
= p« + (l/2)trace((2r/ - pf TT^t _ i^WtpW^^^d))^ 

where p^^) e M is independent of ir^^), Pf \ and we have used K^^)K^^)^ = K^o)ij^{o) 
I — and fT*^^)! = to simplify the expressions. On the other hand, substituting P2°^ 



rll^ + T into the last equation in (21 ), multiplying both sides from left and right by K^^^\ and 
simplifying, gives 

(/ - tl^/n){Ttl^ + T)K^'^^^ + ir(°)t(^iiT + T)(/ - 11^ /n) 

= K(°)tg2K(°)t + r(/-llV^)(/-ll^/n), 



or 



p(o)^(o)t + ^{o)tp(o) ^ K(°)tg2i^(o)t + r{I -11^ In). 
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Using this equality in the equation for trace (P2 ) leads to 

trace(P2^'^) = p^'^ + (1/2) trace((2 rJ - K^'^^^Q^K^^^^ - r{I - 11^ /n))K^^^) 
= + (1/2) trace((r/ - K^''^^Q2K^''^^)K^'^), 

or equivalently 

6J = 6p + (1/2) tiaceiirl - K^Q2K^)6K), 
where 5p is independent of 5K, but can be a function of 5H. This implies, in particular, that 

VkJ = {l/2){rI-K^Q2K^), 

with the gradient being evaluated at the point {{1/Lq)I, K). The proof of the proposition is now 
complete. 
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